Minimally entangled typical quantum states at finite temperature 
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We introduce a class of states, called minimally entangled typical thermal states (METTS), de- 
signed to resemble a typical state of a quantum system at finite temperature with a bias towards 
classical (minimally entangled) properties. These states reveal in an intuitive way properties such as 
short-range order which may be hidden in correlation functions. An algorithm is presented which, 



when used with the density matrix renormalization group (DMRG), is faster by i 
than previous heat-bath approaches for thermally averaged quantities. 



factor of 10-* - 10' 



PACS numbers; 75.10.Jm, 75.40.Mg 

What is a typical wavefunction of a quantum system 
at a finite temperature? The fundamental proposition 
of statistical mechanics is that the density matrix of a 
system at inverse temperature /3 with Hamiltonian H is 
p = exp{—(3H). One can regard p = exp(— as aris- 
ing from several different physical situations: from an en- 
semble average of pure states, from the long time average 
of one system, from quantum mechanical entanglement 
with a heat bath which produces mixed states, or from 
some combination of these effects. The resulting predic- 
tions of statistical mechanics depend only on p. On the 
other hand, statistical mechanics is an idealization; a real 
physical system has a specific history and environment 
which may favor thinking about it in one way over an- 
other. Here we will focus on the cnscmble-of-pure-states 
point of view. We have in mind equilibrating the system 
with weak coupling to a heat bath, and then moving the 
heat bath far from the system, removing any couplings. 
From this viewpoint, our question is a natural one. In 
this paper we propose a set of idealized states which we 
argue are useful to think of as "typical" , and whose en- 
semble generates p = exp(— /3iJ). In addition, the algo- 
rithm we introduce to generate them provides a substan- 
tially more efficient route to determining finite tempera- 
ture properties of lattice models when using diagonaliza- 
tion, density matrix renormalization group (DMRG)[1], 
and tensor product wavefunction approaches^ iS,]. 

What do we mean by typical? We mean that there 
is a set of states {!</'(*)}} with unnormalized probabili- 
ties -P(i), from which we can select states. To reproduce 
statistical mechanics, we require 



^P(z)l0(z))(0(z)| = 



-I3H 



(1) 



Then the expectation value of any Hermitian opera- 
tor A can be determined by an unweighted average of 
{(j){i)\A\(f>{i)), with each chosen at random accord- 

ing to P{i)- We also impose looser criteria based on 
physics: that one can imagine some physical thermaliza- 
tion process which might generate the {\(f>{i))}, and that 
the {10(1))} do not exhibit special "atypical" physical 
characteristics. We do not require that every state in the 



Hilbert space be included in the {\(f>{i))}- 

For classical systems on a lattice, the only reason- 
able typical states are the classical product states (CPS), 
\i) — risitos e 1*^)' where ii labels the states of a site. For 
example, for an Ising model a CPS is a spin configura- 
tion, e.g. \i) = I nil . . .). These states are often gen- 
erated numerically and provide an intuitive understand- 
ing of a system's properties which would be difficult to 
obtain from the system's density matrix. For quantum 
spin systems, one can also generate CPS, but these are 
not typical wavefunctions. For example, at temperature 
T = 0, the typical wavefunction should be the ground 
state, which is generally not a CPS. 

The energy eigenvalues Eg and eigenstates |s) satisfy 
p = '^ge~^^''\s){s\ and thus Eq. ([T]). However, they 
should not be thought of as typical states. Schrodinger 
called this idea "altogether wrong" and "irreconcilable 
with the very foundations of quantum mechanics" ^] . For 
a large system, excluding very low temperature, equili- 
bration processes do not drive the system to any single 
eigenstate. Any such process would take an exponentially 
long time (in the number of particles N) because of the 
exponentially small energy level spacing. The eigenstates 
are also exponentially sensitive to uncertainties in the 
Hamiltonian. Nevertheless, more recent introductions to 
statistical mechanics than Schrodinger's often give the 
impression (sometimes without explicitly saying so) that 
the typical thermal wavefunction is an eigenstate of the 
Hamiltonian^. 

It is easy to construct other states satisfying Eq. ([1]). 
Let {\i)} be any complete orthonormal basis of the sys- 
tem. Define the normalized (but not orthogonal) set of 
"typical" states 

|</.(z)}=P(z)-i/2exp(-/3i7/2)|z), (2) 

where 

P(z) = (i|exp(-/3i/)|z) =Tr{p|i}(z|}. (3) 

Note that the partition function is given hy Z = Trp = 
J2i P{i)- We see Eq. ([T]) immediately follows, and 

P{i) 



{A) EE -TT{pA} 



Y^^{cj>{^)\Am). (4) 
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Note that similar results are obtained if the states 
are not orthonormal, provided there exists a positive set 
of weights p{i) such that p{i)\i) {i\ — 1, and similarly 
for a continuous distribution of states. 

The energy eigenstates can serve as the set \i), in which 
case \4>{i)) = Another choice is to select the {\i)} as 
random normalized vectors in the Hilbert space, selected 
using the Haar measure; this might be considered a math- 
ematically natural definition of typical states. Both of 
these approaches are intractable computationally except 
on the smallest systems. Exact energy eigenstates would 
be unsuitable even for a Lanczos approach because of the 
small level spacings-a full diagonalization of H would be 
required. These choices are also poor from a physical 
point of view. In a broken symmetry phase, these states 
would tend to be highly non-classical superpositions of 
many states with different values of the order param- 
eter. If the system consisted of two widely separated 
noninteracting subsystems, the random vector approach 
would give highly entangled states of the two subsystems. 
These choices ignore decoherence effects, which tend to 
eliminate highly-non-classical entanglement. 

We take as our favored "typical" states the 
ones with the least entanglement, generated by taking 
to be a CPS. By entanglement we mean we con- 
sider dividing the system into two parts, say by taking 
a dividing plane, and calculating the von Neumann en- 
tanglement entropy S between the two parts. A CPS 
has S = for any division. At nonzero /3 we expect 
the resulting \4>ii)) to have minimal entropy within this 
general class of states, and so we call them minimally en- 
tangled typical thermal states (METTS). METTS have 
a number of nice properties. A METTS for a system 
with noninteracting subsystems is a product of METTS 
for the subsystems. For systems with long-range order, 
METTS break symmetries, choosing an order parameter 
at random. Even for systems without broken symmetries, 
METTS reveal underlying short-range order. 

We give two approaches to the calculation of METTS. 
The ancilla method^ 0] uses a set of auxilliary sites act- 
ing as a heat bath, and has been used to simulate finite 
temperatures using time dependent DMRG methods [1]. 
It's adaptation to produce METTS resembles a highly 
idealized physical thermalization process. The pure state 
method does not use a heat bath and is more efficient. 

To describe the ancilla method 0], let us take the sys- 
tem A to be composed of N spins with S = 1/2. The 
heat bath B is also composed of iV S — 1/2 spins (called 
ancilla), and we pair up the spins in A and B — for a ID 
system, think of a ladder. Label the sites by i and let 
\ie)A label the local states of the system site at £, and 
similarly for B. The initial unnormalized pure state of 
A + B which describes infinite temperature is 

|V(/3 = 0)) =^...^|il)^|il)B...Njv)ANiv)B (5) 
ii ijv 



This state is a product of site-ancilla pair states, with 
each pair maximally entangled. If one traces out the 
ancilla from \^p){'llJ\, one obtains the infinite temperature 
density matrix 1 . The Hamiltonian oi A + B is that of A 
alone: there are no A — B or B — B terms. Let 

|^(/3)) =exp(-/3i//2)|VX0)). (6) 

We find TrB|V'(/3))(V'(/3)l = exp(~fjH). Alternatively, 
one can measure any operator O of A as (O) — 
{ip{f3)\0\ip{/3)). The calculation of is easily per- 

formed using imaginary time-dependent DMRG [8], with 
initial state \ip{l3 — 0)). 

To obtain a pure state for A from the entangled state of 
A+B, we perform a physical measurement of all the spins 
of B. A physical measurement projects the wavefunction 
into one eigenstate of the measured operator, with the 
appropriate probability. Specifically, to measure one par- 
ticular spin in the z direction, compute -P(t) = (Sz) + 
let P{i) = 1 - P(t), and set 

r m)-*IT)(TIV') probF(T) . . 

l^a)-^u)aiV') probpa) ^ ' 

Note that we get the same probability distribution 
whether we measure the sites sequentially or jointly all 
at once, but sequentially is much more convenient nu- 
merically, taking one half-sweep in DMRG^. We are 
free to measure each spin with respect to any axis, all 
the same or different, randomly or predetermined. The 
probability of the final CPS is given by Eq. The 
measurement puts the combined system into the product 
state 

p(t)-'^'\t)BmBm) = \^)Bm))A (s) 

At this point one can ignore B. Note that the initial 
perfect entanglement takes the place of the coupling one 
would have in a real thermalization process. 

In the pure-state method, we start with any CPS \i), 
and apply exp(— /3i7/2). We then physically measure a 
new CPS \i') from this state, and apply exp(— /3i7/2) to 
it, etc. We call one iteration a "thermal step". This pro- 
cess resembles Monte Carlo, but with the quantum mea- 
surement process taking the place of the usual spin fiips. 
The set of METTS are a fixed point of this process: con- 
sider an infinite ensemble of such systems, initially with 
|z) distributed with probabihty P{i). Then by Eq. ([4]), 
the ensemble of \4>ii)) correctly reproduces all thermody- 
namic measurements, so a set of determined from it 
is correctly distributed with probability P{i')- 

To study METTS in more detail, we consider the one 
dimensional S = ^ Heisenberg model, with Hamiltonian 

(9) 

I 

and with open boundary conditions. We implement the 
algorithms using time-dependent DMRG with a second 
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FIG. 1: Energy of a 100 site Heisenberg chain at various tem- 
peratures. In the main figure, the dashed hues label the re- 
sults of the ancilla approach, considered exact. The symbols 
are derived from repeated use of the pure-state method, with 
each use starting from a new completely random state \i) and 
proceeding 10 thermal steps. For a fixed thermal step, we 
averaged over the ensemble. The inset shows one long pure- 
state calculation. The open circles show energies of individual 
METTS, while the solid line shows the moving average. The 
dashed line shows the ancilla result. 
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FIG. 2: Properties of METTS for a 200 site Heisenberg 
chain, central 30 sites. Each panel shows properties of a 
single METTS generated for the indicated temperature (the 
METTS in the different panels are unrelated) . The three solid 
lines (red, black, green) without symbols show ( — 1)^(5"), for 
a = x,y,z (which line is x, etc., is arbitrary). The open 
squares at the top show Ct. The open circles show {S ■ S) on 
each bond. 



order breakup and with a time step of 0.05. The physical 
measurements generating the \i) were done at different 
random orientations for each spin and thermal time step. 

In Fig. 1 we show that the two algorithms give the 
same (numerically exact) results for the energy on a 100 
site Heisenberg chain. The main figure shows that for 
the pure-state method, one reaches the equilibrium dis- 
tribution for the energy very precisely after 5-10 thermal 
steps, starting from a random configuration. This sug- 
gests that the thermal-step autocorrelation time (simi- 
lar to a Monte Carlo autocorrelation time) is very short, 
the key to efficient sampling. In practical calculations 
(inset) one does one long run with many thermal steps, 
discarding the first results as being a warmup, say about 
10 steps. Averaging over only 100 METTS obtained in 
Nr = 100 thermal steps (-1-10 for the warmup), we ob- 
tain the total energy to a relative accuracy of about 10^^. 
The fluctuations in the total energy are quite small; one 
can obtain reasonable results with only one METTS. 

With DMRG, particularly for low temperatures and 
modest accuracies, the pure-state METTS method is 
much faster than the ancilla method for obtaining ther- 
mal averages. (For averages, there is no point in generat- 
ing METTS with the ancilla method, since averages can 
be measured directly.) Suppose for a specified accuracy a 
system requires mo states per block for a T = standard 
DMRG calculation. In pure-state METTS we solve the 
imaginary-time-dependent Schrodinger equation from 
to P/2. We find that for pure-state METTS, the m re- 
quired starts at 1 for small imaginary time and satu- 
rates to mo for very large imaginary times, which are 
only needed for large /?. The calculation time scales as 



NniQPNr, where N is the number of sites. In the ancilla 
method, in the limit of low temperatures, the heat bath 
and the system both independently encode the ground 
state, as a product state but with their sites intermin- 
gled. This means that DMRG requires niQ states, and 
the calculation time scales as Nrrigf], bigger by a factor 
of rn^/Nr compared to the pure-state METTS approach. 
Typical values of too are 50 — 5000 for systems ranging 
from simple ID spin chains to 2D clusters with width 
8 — 10. Consequently, taking Nr = 10 — 100, the pure- 
state METTS method is faster by a factor of 10^ - 10^°. 

In Fig. 2 we show properties of some METTS for a 
Heisenberg chain. All the measurements show substan- 
tial randomness, which diminishes at lower temperatures 
as the METTS approach the ground state. Since the 
model is antiferromagnetic, we multiply the spin mea- 
surements by (—1)^ to make twisting of the antiferromag- 
netic order more apparent. For example, for /3 = 8, pro- 
nounced twisting is visible near t = 105 — 110. The values 
of {S ■ S) show an increase in dimerization in the same re- 
gion. Similar twisting and dimerization is visible at /? = 3 
near £ — 100 — 108. We know that at finite temperature, 
the system has a finite spin-spin correlation length; this 
could come about (we imagine) via random twisting of 
the spin order, by regions with strong dimerization, or 
some combination. In these METTS both effects occur, 
with twisting being somewhat more pronounced. The 
open squares measure d = {{S^f + (S^^)^ + {Slff^. If 
the measurements included ensemble averaging, Ci would 
always be zero. Instead, it measures how classical a spin 
is — how entangled it is within the METTS. For an iso- 
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FIG. 3; Entanglement entropy at the center bond of a 40 site 
Heisenberg chain as a function of real time. Each solid line is 
for a single METTS, while the dashed lines are for an ancilla 
system with 40 sites and 40 ancilla. 



lated S* = 1/2 in any pure state, — 1/2. Any total 
5 = wavefunction would give = for every I. The 
METTS are biased to be as classical as possible, which 
makes Ci meaningful. It is surprising how little variation 
there is in Ci from site to site. 

The METTS can be evolved in real time (say with real- 
time DMRG). The ensemble averages of METTS states 
are time independent, but the METTS themselves are 
not. Much as a single particle with a narrowly peaked 
wavefunction would spread out in time, METTS evolve 
to states with much higher entanglement entropy. In 
Fig. 3 we show the growth of S with time for several 
different temperatures. In the higher temperature cases, 
the entropy starts smaller but grows more rapidly. The 
same effect is seen in the results for an ancilla system, 
for which the typical entropy is roughly twice that of 
the METTS, in agreement with the behavior of m, with 
m exp(S'). The behavior of the entropy as a function of 
time determines the effectiveness of real-time DMRG to 
calculate finite temperature spectral functions [loj. Our 
results show that METTS will be able to reach longer 
times than the ancilla approachflO]. 

The rapid growth of entanglement with time for 
METTS raises the question of whether METTS (at t = 0) 
really are "typical" wavefunctions of real systems. The 
answer is very likely no, typical wavefunctions have more 
entanglement than METTS, with eventual entanglement 
growth limited by decoherence. One can evolve an en- 
semble of METTS to some fixed time i; the resulting set 
of states also satisfy Eq. ([T]), would exhibit more en- 
tanglement, and thus could be considered as being more 
realistic physically. However, the METTS themselves are 
more useful computationally. 

We briefly note several other approaches to finite tem- 
peratures. A quite different (but powerful) finite temper- 
ature DMRG approach for infinite, translationally invari- 
ant ID systems is transfer matrix DMRG [HI. More 
closely related to our work are two approaches adapted 
for Lanczos calculations 13, 



random vector. One utilizes completeness properties of 
Lanzcos (Krylov) expansions to produce an approxima- 
tion to canonical ensemble results [l3|. The other ap- 
proach produces microcanonical results by minimizing 
(H — A)^, obtaining not a single eigenstate but a su- 
perposition of many which is narrow in energy 1J| . The 
DMRG approach 15] starts with a random vector chosen 
from the (incomplete) DMRG basis and uses a regulated 
polynomial expansion to apply exp(— /3i?/2). None of 
the approaches utilize physical measurement or a GPS 
starting state \i) chosen with probability Pii). We be- 
lieve METTS has a more rigorous foundation, e.g. not 
dependent on any completeness properties of the Lanc- 
zos or DMRG basis, and applicable to any temperature. 
METTS also provide very useful intuition about the na- 
ture of the system at finite temperature. 
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1J| and one recent DMRG 



approach Jjj. Both Lanczos approaches start with a 
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